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CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the benefit 
5 of priority from the prior Japanese Patent Application No. 
2003-129840, filed on May 8, 2003, the entire contents of 
which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

10 

1. Field of the Invention 

This invention relates to a bus connection circuit and 
bus connection system utilizing data pre-fetch functions in 
a computer system requiring high-speed and large-volume data 

15 transfer, and in particular relates to a bus connection 

circuit and bus connection system utilizing data pre-fetch 
functions to raise the efficiency of transfer of large 
volumes pf data, in a computer system having an internal PCI 
bus • 

20 . 

2. Description of the Related Art 

In recent years computer systems have widely adopted 
PCI (Peripheral Component Interconnect) buses as a standard 
bus specification capable of high-speed transfer of large 
25 amounts of data. PCI is a bus standard advocated by U.S. 
Intel Corporation; specifications for this standard have 
been developed and published by the PCI Special Interest 
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Group (PCI SIG) , an industry association in the U.S. A PCI 
bus is used in particular to connect an I/O device and 
memory via a chipset, and is useful for speeding the 
transfer of data between the I/O devices and the memory. 
5 Fig. 7 is a block diagram of a computer system using a 

PCI bus, and shows a computer system comprising a CPU 101, 
memory controller 100, memory 102, bridge circuit 103, and 
PCI devices 104A and 104B. The PCI devices 104A and 104B 
are connected to the bridge circuit 103 by the PCI bus 114, 

10 and the CPU 101, the memory 102 and the bridge circuit 103 
are connected to the memory controller 100 by the processor 
bus 111, the memory bus 112, and the memory controller bus 
113, respectively. 

The PCI devices 104A and 104B can access the memory 102 

15 via the bridge circuit 103 and the memory controller 100. 
The bridge circuit 103 performs connection operations to 
absorb differences in bus data rates, protocols and similar 
between the memory control bus 113 and the PCI bus 114. 

Because data transfer via this bridge circuit 103 may 

20 impede the high-speed operation of the PCI bus, in order to 
raise throughput, a plurality of pre-f etch. buff ers are 
provided in the bridge circuit 103 (for example, Japanese 
Patent Laid-open No. 11-238030). 

Fig. 8 is a drawing of the configuration of a computer 

25 system comprising a conventional bridge circuit 103 in which 
is provided a pre-f etch buffer. This computer system 
comprises a plurality of PCI devices 104A through 104D, a 



bridge circuit 103 , and memory units 100 and 102. The PCI 
devices 104A to 104D and the memory units 100, 102 are 
connected by the PCI bus 114 and by the memory buses 113, 
112 respectively to the bridge circuit 103. 
5 The bridge circuit 103 has a PCI interface circuit 210/ 

a plurality of pre-fetch buffers 221A to 221D corresponding 
to each of the PCI devices 104A to 104D, and a memory 
interface circuit 230. The PCI devices 104A to 104D each 
have a PCI interface circuit 24 0, which has a set of a REQ 

10 signal and a GNT signal. 

Fig. 9 explains the sequence of operations in the 
computer system of Fig. 8 when a plurality of PCI devices 
execute memory read requests; these operations, are explained 
in detail below. 

15 (1) When the PCI device 104A executes a memory read 

request from internal circuitry, the PCI device 104A uses a 
request signal REQ331A to send a request to the PCI bus 114. 

(2) The PCI interface portion 240 of the PCI device 
104A, on receiving a grant signal GNT332A from the bridge 

20 circuit 103, initiates a memory read request transaction 
according to the PCI bus protocol. 

(3) The PCI interface portion 210 of the bridge circuit 
103/ on receiving the memory read request, assigns a pre- 
fetch buffer 221A corresponding to REQ331A/GNT332A, and 

25 issues a retry response to the PCI bus 114. 

(4) On receiving the retry response, the PCI device 
104A temporarily releases the PCI bus 114, so that another 



PCI device can use the PCI bus. 114. 

(5) The pre-fetch buffer 221A assigned as described 
above issues a memory read request to perform memory reading 
to the memory interface portion 230. 
5 (6) The memory interface portion 230 initiates a memory 

. read request transaction with the memory units 100 and 102. 

(7) Read data is transferred from the memory units 100 
and 102^ and is stored in the pre-fetch buffer 221A assigned 
as described above. 

10 The PCI devices 104B to 104D execute memory read 

requests similarly to the operations (1) through (7) above. 
Normally, after the memory interface portion 230 of the 
bridge circuit 103 executes a memory read, an extremely long 
time elapses before the read data is received, and so the 

15 operations (1) through (7) performed by each of the PCI 
devices 104A to 104D overlap with a time difference. 

(8) Through operations similar to (1) through (3), the 
PCI device 104A executes a memory read request to the bridge 
circuit 103. 

20 (9) The PCI interface portion 210 of the bridge circuit 

103, on receiving the memory read request, confirms the pre- 
fetch buffer 22 lA corresponding to the REQ331A/GNT332A used 
by the request, and when read data is stored therein, 
initiates data transfer to the PCI bus 114. 

25 Through operations similar to (8) and (9), the PCI 

devices 104B to 104D also execute memory read requests to 
the bridge circuit 103 and initiate read data transfer. 



As described above, by using pre-fetch buffers, the PCI 
bus can be used effectively and the overall system 
throughput is improved. 

Thus in the technology of the prior art, by preparing a 
5 plurality of pre-fetch buffers in the bridge circuit, high- 
speed memory access is possible through time-division of the 
PCI bus among a plurality of PCI devices. However, 
depending on the circuit configuration, there may be cases 
in which the number of PCI devices connected to the PCI bus 
10 may be smaller than the number of pre-fetch buffers. 

For example, as shown in Fig. 10, there is the case of 
a computer system comprising a single PCI device 104A, a 
bridge circuit 103, and memory units 100 and 102. Here, the 
PCI device 104A and the memory units 100 and 102 are 
15 connected to the bridge circuit 103 via a PCI bus 114 and 
memory buses 113 and 112, respectively. The bridge circuit 
103 has a plurality of pre-fetch buffers 221A to 221D. 
Further, the PCI device 104A has one set of REQ/GNT signals. 

Fig. 11 explains the sequence of operations in the 
20 computer system of Fig^ 10 when the PCI device 104 A executes 
a memory read request; operations are indicated in detail 
below. 

(1) When the PCI device 104A executes a memory read 
request, the PCI device 104A uses REQ531 to send a request 

25 to the PCI bus 114. 

(2) The PCI interface portion 240 of the PCI device 
104A, on receiving a GNT532 signal from the bridge circuit 



103, initiates a memory read request transaction according 
to the PCI bus protocol. 

(3) The PCI interface portion 210 of the bridge circuit 
103, on receiving the. memory read request, assigns a pre- 

5 fetch buffer 221A corresponding to REQ531/GNT532 , and issues 
a retry response to the PCI bus 114. 

(4) On receiving the retry response, the PCI device 
104A temporarily releases the PCI bus 114. 

(5) The pre-fetch buffer 221A assigned as described 

10 above issues a memory read request to perform memory reading 
to the memory interface portion 230. 

(6) The memory interface portion 230 initiates a memory 
read request transaction with the memory units 100 and 102. 

(7) The PCI device 104A again executes a memory read 
15 request to the bridge circuit 103, similarly to the actions 

(1) to (3). 

(8) The PCI interface portion 210 of the bridge circuit 
103, on receiving a memory read request, confirms the pre- 
fetch buffer 22 lA corresponding to the REQ531/GNT532 used by 

20 the request, and because read data is not yet stored therein> 
sends a retry response to the PCI bus 114. 

(9) When the PCI device 104A, on receiving the retry 
response, temporarily releases the PCI bus 114. The 
operations (7) through (9) are repeated several times. 

25 (10) Read data is transferred from the memory units 100 

and 102, and is stored in the pre-fetch buffer 22 lA assigned 
as described above. 



(11) The PCI device 104A executes a memory read request 
to the bridge circuit 103, similarly to the operations (1) 

. to (3). 

(12) On receiving the memory read request , the PCI 

5 interface portion 210 of the bridge circuit 103 confirms the 
pre-fetch buffer 22 lA corresponding to the REQ531/GNT532 
used by the request, and when read data is stored therein, 
^ initiates data transfer to the PCI bus 114. 

In this way, when only one PCI device is connected, 
10 only one pre-fetch buffer is used corresponding to REQ/GNT, 
and so the PCI device can only execute one memory read 
request at a time. 

Consequently the time from when the PCI device sends a 
memory read request and the bridge circuit returns a retry 
15 response until read data is stored in the pre-fetch buffer 
is a time of merely repeating read requests prompted by 
retry responses, and is completely wasted, so that overall 
system throughput is lowered. 

Moreover, normally the time from execution of a memory 
20 read by the memory interface portion of the PCI bus until 

data is received is extremely long, so that even if a memory 
read request is again executed immediately after a retry 
response, the bridge circuit merely sends a retry response 
to the PCI biis once again, and the PCI bus is used 
25 wastefully, so that overall system throughput is lowered. 

Further, when a PCI device is prompted for a memory 
read request through a retry response from the bridge 



circuit simultaneously with an initial memory read request^ 
and the memory read request for the retry response obtains 
PCI bus use privileges and a memory read request transaction 
is initiated, because there is a large possibility that read 
5 data is not stored in the pre-f etcli buffer of the bridge 
circuit as explained above, the PCI bus is used wastefully, 
and there is a high probability that overall system 
throughput will be lowered. 

10 SUMMARY OF THE INVENTION 

Hence an object of this invention is to provide a bus 

connection circuit and bus connection system to enable 

effective utilization of pre- fetch buffers, even when the 
15 number of bus connection devices is fewer in number than the 

number of the plurality of pre- fetch buffers in the bridge 

circuit, and to improve system throughput. 

A further object of this invention is to provide a bus 

connection circuit and bus connection system which, by 
20 reducing wasteful read requests prompted by retry responses 

from a bridge circuit, reduce wasted use of the bus and 

improve the efficiency of data transfer. 

In order to achieve these objects, a bus connection 

circuit of this invention is connected via a bus to a bridge 
25 circuit having a plurality of pre-f etch buffers to pre-f etch 

data from an external device, receives data from the above 

pre-fetch buffers after request assertion, and has a 
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plurality of request queues, an arbiter which performs 
arbitration of requests from the above plurality of request 
queues, and a bus interface portion which outputs a request 
signal indicating allocation of the above pre-fetch buffers 
5 corresponding to requests arbitrated by the above arbiter 
and which receives corresponding grant signals from the 
above bridge circuit. 

Further, a bus connection system of this invention has 
a bridge circuit having a plurality of pre-fetch buffers for 

10 pre-f etching of data from memory, and a bus connection 

circuit, connected to the above bridge circuit via a bus, 
which after request assertion receives data from the above 
pre-fetch buffers. And. the above bus connection circuit has 
a plurality of request queues, an arbiter which performs 

15 arbitration of requests from the above plurality of request 
queues, and a bus interface portion which outputs a request 
signal indicating allocation of the above pre-fetch buffers 
corresponding to requests arbitrated by the above arbiter 
and which receives corresponding grant signals from the 

20 above bridge circuit i : . 

By means of this invention, a plurality of request 
queues and a plurality of request signal outputs and grant 
signal inputs are provided in a single bus connection device, 
so that through a single bus connection device, the 

25 plurality of pre-fetch buffers in a bridge circuit can be 
used effectively, and wasteful read requests prompted by 
retry responses from the bridge circuit can be reduced, so 



that wasteful use of the PCI bus can be decreased. As a 
result, the data transfer efficiency can be raised, and the 
overall system throughput can be improved. - 

In this invention, it is preferable that the above bus 
5 interface portion release the above bus through the above 
request signal according to reception of a retry response 
from the above bridge circuit in reply to the above request 
signal, and output to the above bus a request signal 
indicating the allocation of other pre- fetch buffers. As a 

10 result, a single bus connection circuit can send requests to 
the bridge circuit in order, and throughput can be improved. 

In this invention, it is preferable that the above 
request queue perform assertions giving priority to an 
initial read request over a read request prompted by a retry 

15 response as described above. As a result, assertion of 

other requests can be given priority in the bridge circuit 
over requests prompted by retry responses, so that the bus 
can be used more effectively. 

Further, in this invention it is preferable that the 

20 above request queues each have a register which sets the 
time from receipt of the above retry response to assertion 
of the read request corresponding to the above retry 
response. As a result, the time until a read request for a 
retry response can be set freely according to the system. 

25 Further, in this invention it is preferable that the 

bus connection circuit further have an internal circuit 
which issues read requests to said plurality of request 
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queues. As a result, processing Is easy even when read 
requests are issued in order from the internal circuit. 

Further, in this invention it is preferable that the 
above requests be read requests to memory via the above 
5 bridge circuit. As a result, the efficiency of read 
transfers of large volumes of data can be jLmproved. 

Further, in this invention it is preferable that the 
above bus is a PCI bus. As a result, the performance of a 
PCI bus capable of high-speed transfer can be achieved. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the computer system of an 
embodiment of this invention; 
15 Fig. 2 is a block diagram of the PCI device of Fig. 1; 

Fig. 3 shows the flow of processing of the state 
machine of the PCI device of Fig. 1; 

Fig. 4 is a block diagram of the bridge circuit of Fig. 

1; 

20 Fig. 5 shows the flow of processing of the buffer state 

machine shown in Fig. 4; 

Fig. 6 explains the read request operation of Fig. 1; 
Fig. 7 is a block diagram of a conventional computer 
system; 

25 Fig. 8 is a block diagram of a computer system 

comprising a conventional PCI device; 

Fig. 9 shows the conventional read request operation 
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sequence; 

Fig. 10 explains problems with conventional PCI 
devices ; and , 

Fig. 11 shows the read request sequence of the 
5 conventional PCI device of Fig. 10 • 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Below, embodiments of this invention are explained in 
10 the order of a bus connection system comprising a bus 

connection circuit, memory read operation using a bus, and 
other embodiments . 

Bus Connection System 

Fig. 1 shows the configuration of a computer system 
15^ comprising a PCI device, in an embodiment of this invention. 
As shown in Fig. 1, the PCI device 601 has an internal 
circuit 650, four read request queues 65lA to 651D/ an 
arbiter 652, and a PCI interface portion 641. 

This PCI device 601 is connected to the bridge circuit 
20 602 via -the PCI bus 611 and the four REQ/GNT lines -and 

response lines. Also, the memory unit 603 is connected to 
the bridge circuit 602 by the memory bus 612. The bridge 
circuit 602 has a PCI interface circuit 620, four pre-fetch 
buffers 621A to 621D, and a memory interface circuit 622. 
25 Each of the four read request queues 651A to 651D of 

the PCI device 601, upon receiving a read request from the 
internal circuit 650 of the PCI device 601, sends the read 
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request to the arbiter 652. 

The arbiter 652 performs arbitration of the read 
request queues 651A to 65 ID, and sends a read request from 
one to the PCI interface portion 641. The state machine 653 
5 provided within the PCI interface portion 641 asserts a REQ# 
signal on the request line corresponding to the read request 
queue among the plurality of requests REQ# on the PCI bus 
611. ^ 

The configuration of the PCI device 601 of Fig. 1 is 

10 explained in further detail, referring to Fig. 2 and Fig. 3. 
As shown in Fig. 2, the read request queues 651A to 651D of 
the PCI device 601 respectively comprise state machines 861A 
to 861D which store the request state; counters 862A to 862D 
which count the interval at which the read request queue 

15 sends arbitration requests; comparators 863A to 863D which 
detect the fact that the counter value has exceeded a preset 
value; and registers 864A to 864D which hold addresses, 
commands,, and other information. 

The arbiter 652 comprises a first arbitration circuit 

20 852A, which performs arbitration between high-priority read 
requests from the request queues 651A to 651D; a second 
arbitration circuit 852B, which performs arbitration between 
low-priority read requests; a third arbitration circuit 853, 
which performs arbitration between the outputs of the first 

25 and second arbitration circuits 852A and 852B with a fixed 
order of priority; and a multiplexer 854 which selects the 
request information (address command) from the selected read 



request queue. 

When there is a high-priority read request and a low- 
priority read request/ the third arbitration circuit 853 
always asserts the high-priority read request. 
5 The PCI interface portion 641 performs PCI interface 

control of the PCI bus 611, and has a state machine 653 
which performs PCI interface control to extract the read 
request selected by arbitration from the arbiter 853 when 
the PCI bus 611 is released, assert the REQ# on the 

10 corresponding request line, and transmit the iGNT# of the 
grant line to the corresponding queue. 

As shown in Fig. 3, the state machines 861A to 861D 
within the corresponding read request queues 651A to 651D, 
upon receiving a new read request from within the PCI device 

15 601, enter a first state of asserting the request with high 
priority, and upon receiving a retry response from the 
bridge circuit 602, enter a second state of asserting the 
request (a request according to a retry response) with low 
priority. Further, on receiving a grant signal GNT, a state 

20 machine initiates a transaction and goes active-, and upon 
completing data transfer returns to the idle state. 

Consequently initial read requests are given priority 
(high priority), read requests can be sent to the bridge 
circuit 602, and the PCI bus can be utilized effectively, so 

25 that overall system throughput can.be raised. 

The interval (fixed length of time) of read requests 
according to retry responses from the bridge circuit 602 is 
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set as a request threshold value in the comparators 863A to 
8 6 3D in the read request queues 651A to 651D, The 
comparators 863A to 8 6 3D compare this value and the count 
value, and when the count value exceeds the request interval 
value, can assert a read request for a retry response. 

The state machine 653 of the PCI interface portion 641, 
upon receiving a grant signal GNT# in the idle state, 
becomes active, and upon either receiving a retry response 
or detecting completion of data transfer, returns to the 
idle state. 

Next, the bridge circuit 602 is explained using Fig. 4 
and Fig. 5. As shown in Fig. 4, the PCI interface portion 
620 has a page address register 623, address comparison 
portion 624, target state machine 625, and PCI arbiter 626. 
The pre-fetch buffers 62 lA to 6 2 ID each comprise a buffer 
control portion having a buffer state machine 627 (see Fig. 
5) and a pre-fetch buffer 628. 

. The PCI arbiter 626 receives the REQ# signal from the 
PCI device and asserts the grant GNT# signal. The PCI 
device can initiate a transaction only when the grant GNT# 
signal is received, and so the bridge circuit 602 examines 
the GNT# signal asserted by the PCI device and can judge 
which PCI device has initiated the transaction. 

The PCI device, upon initiating the transaction, first 
sends an address to the AD (address data) line of the PCI 
bus 611, and so the PCI interface portion 620 compares the 
value stored in the page address register 623 and the 
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received address using the comparator 624. If the addresses 
match/ the target machine 625 is started ^ and the PCI 
interface portion 620 notifies the buffer control portions 
62 lA to 621D of receipt of a read request, and transfers the 
5 received address . 

As shown in Fig. 5, when the state machines 627 of the 
buffer control portions 62 lA to 62 ID judges to receive a 
read request from the read request reception signal from the 
PCI interface portion 620 and the GNT signal from the PCI 

10 arbiter 626, and when a read request is initially received, 
or if read data has not been prepared, a retry response is 
sent. If the read data is prepared in the pre-fetch buffer 
628, the target state machine 625 is notified of the fact 
that data can be transferred, and data is transferred to the 

15 PCI interface portion 620. 

The, target state machine 625 of the PCI interface 
portion 620 performs a transaction with the PCI bus 611 
according, to whether the response from the buffer control 
portion 62 lA to 62 ID is a retry response or indicates that 

20 data . transfer is possible. ^ . 

PCI Device Memory Read Operation 

Figi 6 shows the sequence of operations when the PCI 
device 601 executes a memory read request in the computer 
system of Fig. 1 through Fig. 5; details of these operations 
25 are indicated below. 

(1) Each read request queue 651A to 651D sends a memory 
read request. 
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(2) The PCI interface portion. 641 of the PCI device 601 
executes the memory read request from the read request queue 
651A through the request REQ731A. 

(3) The PCI interface portion 620 of the bridge circuit 
5 602 assigns the pre-fetch buffer 62 lA, sends a retry 

response to the PCI bus 611, and releases the PCI bus 611. 

(4) The pre-fetch buffer 621A sends a read request to 
perform a memory read to the memory interface portion 622. 

(5) The memory interface portion 622 initiates a memory 
10 read request transaction with the memory unit 603. 

(6) Memory read data is transferred from the memory 
unit 603 and is stored in the pre-fetch buffer 62 lA. 

The memory read requests of the read request queues 
65 IB to 65 ID are executed in operations similar to those of 

15 (2) through (6). Because normally the time after the memory 
interface portion 622 of the bridge circuit 602 executes a 
memory read until the read data is received is extremely 
long/ the operations (2) through (6) for the read requests 
of each of the read request queues 65 lA to 651D are 

20 performed in parallel with a time difference. 

(7) The read request queue 651A sends a memory read 
request/ and the PCI interface portion 641 of the PCI device 
601 executes the memory read request through REQ731A. 

(8) The PCI interface portion 620 of the bridge circuit 
25 602 confirms the pre-fetch buffer 621A, and initiates 

transfer of the stored read data to the PCI interface 
portion 620. 



(9) The PCI interface portion 620 of the bridge circuit 
602 initiates data transfer of read data to the PCI bus 611. 

The read request queues 65 lA to 65 ID likewise again 
execute memory read requests and initiate read data transfer, 
5 through operations similar to those of (8) and (9), 

In this way, by providing a plurality of read request 
queues in one PCI device and providing a plurality of 
REQ/GNT signals corresponding to each read request queue, 
the plurality of pre-fetch buffers of the bridge circuit can 
10 be utilized effectively and the PCI bus can be used 

effectively, so that overall system throughput is improved. 

As explained in Fig. 2, the read request queues 
comprise state machines 861A to 861D which store the states 
of the respective requests , a counter which counts the 
15 intervals in which the read request queue outputs 

arbitration requests, comparators which detect when a 
counter value exceeds a preset value, and a register which 
holds addresses, commands, and other information. 

Hence the interval of read requests for retry responses 
20 from the bridge circuit can be set in the comparator of the 
read request queue as a request interval value, and when the 
comparator compares this value with the counter value and 
finds that the counter value has exceeded the request 
interval value, the read request for a retry response can be 
25 asserted. Consequently in the second and subsequent read 

requests, wasted PCI bus use by the bridge circuit merely to 
return retry responses can be reduced, and the overall 
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system throughput can be raised. 

Further^ when a state machine within a read request 
queue receives a new read request from within the PCI device / 
a state machine enters first state in which the request is 
5 asserted with high priority, and when a retry response is 
received ' from the bridge circuit, the state machine enters a 
second state- in which the request is asserted with low 
priority. 

Consequently an initial read request can be given 
10 priority when sending a read request to the bridge circuit, 
and the PCI bus can be utilized effectively, so that overall 
system throughput can be raised. 

Other Embodiments 

In the above explanation, the system connected a PCI 
15 device having four request queues to a bridge circuit having 
four pre-fetch buffers; but similar application to a system 
connected to two PCI devices each having two request queues 
is possible. 

Further, the number of pre-fetch buffers and the number 
20 of request queues are not limited to four, and application 
is possible if there are a plurality of two or more. 
Further, the above explanation was for a PCI bus, but 
application to other bus types is also possible. 

In the above, this invention was explained through 
25 aspects, but the present invention is not limited to the 
above aspects, and of course comprises various aspects 
obtained through appropriate modifications within the range 

19 



within which the objects and advantages of the invention are 
not lost. 

As explained above ^ as a result of this invention a 
single bus connection device is provided with a plurality of 
5 request queues and with a plurality of request signal 
outputs and grant signal inputs^ so that a single bus 
connection device can make effective use of the plurality of 
pre-fetch buffers of a bridge circuit, wasted read requests 
according to retry responses from the bridge circuit can be 
10 reduced, and wasted use of the PCI bus can be decreased. 

Consequently the data transfer efficiency can be raised, and 
overall system throughput can be improved. 
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